04/16/21 - 15:04

Dataset statistics

Number of variables	22
Number of observations	16617
Missing cells	133428
Missing cells (%)	36.5%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	3.9 MiB
Average record size in memory	244.0 B

Variable types

Numeric	11
Unsupported	7
Categorical	4

Warnings

`danger` has constant value "1.0"	Constant
`operation_car` has constant value "28.0"	Constant
`operation_date` has a high cardinality: 2162 distinct values	High cardinality
`destination_esr` is highly correlated with `operation_st_esr`	High correlation
`operation_st_esr` is highly correlated with `destination_esr`	High correlation
`operation_car` is highly correlated with `danger` and 1 other fields	High correlation
`danger` is highly correlated with `operation_car` and 1 other fields	High correlation
`adm` is highly correlated with `operation_car` and 1 other fields	High correlation
`index_train` has 16617 (100.0%) missing values	Missing
`danger` has 16595 (99.9%) missing values	Missing
`loaded` has 16617 (100.0%) missing values	Missing
`operation_train` has 16617 (100.0%) missing values	Missing
`rod_train` has 16617 (100.0%) missing values	Missing
`ssp_station_esr` has 16617 (100.0%) missing values	Missing
`ssp_station_id` has 16617 (100.0%) missing values	Missing
`weight_brutto` has 16617 (100.0%) missing values	Missing
`df_index` has unique values	Unique
`index_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`loaded` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`operation_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`rod_train` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`ssp_station_esr` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`ssp_station_id` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`weight_brutto` is an unsupported type, check if it needs cleaning or further analysis	Unsupported

Reproduction

Analysis started	2021-04-16 09:04:25.616998
Analysis finished	2021-04-16 09:04:49.049047
Duration	23.43 seconds
Software version	pandas-profiling v2.11.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	16617
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1868957.486
Minimum	11780
Maximum	4175448
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	11780
5-th percentile	121543.2
Q1	822630
median	1685278
Q3	2589453
95-th percentile	4043559.4
Maximum	4175448
Range	4163668
Interquartile range (IQR)	1766823

Descriptive statistics

Standard deviation	1215945.333
Coefficient of variation (CV)	0.6506008524
Kurtosis	-0.858109855
Mean	1868957.486
Median Absolute Deviation (MAD)	867049
Skewness	0.4419132175
Sum	3.105646654 × 10¹⁰
Variance	1.478523054 × 10¹²
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3964928	1	< 0.1%
1928503	1	< 0.1%
1201408	1	< 0.1%
3883462	1	< 0.1%
1520076	1	< 0.1%
4060420	1	< 0.1%
4062884	1	< 0.1%
124166	1	< 0.1%
2333961	1	< 0.1%
3897231	1	< 0.1%
Other values (16607)	16607	99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
11780	1	< 0.1%
18850	1	< 0.1%
18854	1	< 0.1%
18855	1	< 0.1%
18866	1	< 0.1%
18868	1	< 0.1%
18883	1	< 0.1%
18887	1	< 0.1%
18891	1	< 0.1%
18899	1	< 0.1%

Value	Count	Frequency (%)
4175448	1	< 0.1%
4159387	1	< 0.1%
4144452	1	< 0.1%
4071554	1	< 0.1%
4071545	1	< 0.1%
4071479	1	< 0.1%
4071363	1	< 0.1%
4071328	1	< 0.1%
4071308	1	< 0.1%
4071058	1	< 0.1%

index_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

length
Real number (ℝ_≥0)

Distinct	42
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.9989420473
Minimum	0.79
Maximum	1.93
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	0.79
5-th percentile	0.79
Q1	0.83
median	1.06
Q3	1.06
95-th percentile	1.31
Maximum	1.93
Range	1.14
Interquartile range (IQR)	0.23

Descriptive statistics

Standard deviation	0.1915790065
Coefficient of variation (CV)	0.1917819026
Kurtosis	4.833377137
Mean	0.9989420473
Median Absolute Deviation (MAD)	0
Skewness	1.812177886
Sum	16599.42
Variance	0.03670251572
Monotocity	Not monotonic

Histogram with fixed size bins (bins=42)

Value	Count	Frequency (%)
1.06	8410	50.6%
0.83	4944	29.8%
0.79	1065	6.4%
0.85	604	3.6%
1.77	200	1.2%
1.31	166	1.0%
1	159	1.0%
1.3	124	0.7%
1.1	116	0.7%
1.59	102	0.6%
Other values (32)	727	4.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.79	1065	6.4%
0.82	4	< 0.1%
0.83	4944	29.8%
0.85	604	3.6%
0.86	2	< 0.1%
0.87	4	< 0.1%
0.9	65	0.4%
1	159	1.0%
1.05	3	< 0.1%
1.06	8410	50.6%

Value	Count	Frequency (%)
1.93	4	< 0.1%
1.89	4	< 0.1%
1.85	3	< 0.1%
1.77	200	1.2%
1.73	52	0.3%
1.72	40	0.2%
1.7	42	0.3%
1.69	81	0.5%
1.62	4	< 0.1%
1.6	75	0.5%

car_number
Real number (ℝ_≥0)

Distinct	8058
Distinct (%)	48.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	37860856.55
Minimum	22134175
Maximum	96723176
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	22134175
5-th percentile	30116156.8
Q1	30851562
median	42008094
Q3	42203547
95-th percentile	44335966
Maximum	96723176
Range	74589001
Interquartile range (IQR)	11351985

Descriptive statistics

Standard deviation	7617576.23
Coefficient of variation (CV)	0.2011992576
Kurtosis	20.13440121
Mean	37860856.55
Median Absolute Deviation (MAD)	4162618
Skewness	2.916398387
Sum	6.291338533 × 10¹¹
Variance	5.802746763 × 10¹³
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
37847035	30	0.2%
37846995	30	0.2%
37688470	25	0.2%
37814241	17	0.1%
37843927	13	0.1%
37680287	12	0.1%
37677341	12	0.1%
37672938	12	0.1%
37839529	10	0.1%
37816998	10	0.1%
Other values (8048)	16446	99.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
22134175	5	< 0.1%
23597834	1	< 0.1%
24031486	1	< 0.1%
24062358	1	< 0.1%
24097537	1	< 0.1%
24098626	1	< 0.1%
24213803	1	< 0.1%
24286957	1	< 0.1%
24313629	1	< 0.1%
24482465	1	< 0.1%

Value	Count	Frequency (%)
96723176	1	< 0.1%
96699814	1	< 0.1%
96699780	1	< 0.1%
96699749	2	< 0.1%
96699715	1	< 0.1%
96699707	1	< 0.1%
96699657	1	< 0.1%
96699640	1	< 0.1%
96699418	1	< 0.1%
96699350	1	< 0.1%

destination_esr
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	373
Distinct (%)	2.3%
Missing	130
Missing (%)	0.8%
Infinite	0
Infinite (%)	0.0%

Mean	911481.9782
Minimum	76404
Maximum	998100
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	76404
5-th percentile	841402
Q1	871200
median	915502
Q3	950807
95-th percentile	972806
Maximum	998100
Range	921696
Interquartile range (IQR)	79607

Descriptive statistics

Standard deviation	46162.80795
Coefficient of variation (CV)	0.05064588117
Kurtosis	13.6235286
Mean	911481.9782
Median Absolute Deviation (MAD)	35799
Skewness	-1.067673366
Sum	1.502760337 × 10¹⁰
Variance	2131004838
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
841402	712	4.3%
863007	664	4.0%
950807	467	2.8%
912805	374	2.3%
963506	326	2.0%
841604	310	1.9%
893708	300	1.8%
889100	298	1.8%
972806	297	1.8%
911709	277	1.7%
Other values (363)	12462	75.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
76404	1	< 0.1%
234901	3	< 0.1%
637301	1	< 0.1%
802107	1	< 0.1%
817600	2	< 0.1%
830003	9	0.1%
830200	154	0.9%
830709	9	0.1%
831203	1	< 0.1%
831504	1	< 0.1%

Value	Count	Frequency (%)
998100	7	< 0.1%
997502	14	0.1%
996302	6	< 0.1%
995808	18	0.1%
995507	3	< 0.1%
994701	4	< 0.1%
994400	7	< 0.1%
993304	89	0.5%
993107	59	0.4%
992405	12	0.1%

adm
Categorical

HIGH CORRELATION

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	990.0 KiB

20.0	16615
99.0	2

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	66468
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	20.0
2nd row	20.0
3rd row	20.0
4th row	20.0
5th row	20.0

Value	Count	Frequency (%)
20.0	16615	> 99.9%
99.0	2	< 0.1%

Histogram of lengths of the category

Value	Count	Frequency (%)
20.0	16615	> 99.9%
99.0	2	< 0.1%

Most occurring characters

Value	Count	Frequency (%)
0	33232	50.0%
.	16617	25.0%
2	16615	25.0%
9	4	< 0.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	49851	75.0%
Other Punctuation	16617	25.0%

Most frequent character per category

Value	Count	Frequency (%)
0	33232	66.7%
2	16615	33.3%
9	4	< 0.1%

Value	Count	Frequency (%)
.	16617	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	66468	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	33232	50.0%
.	16617	25.0%
2	16615	25.0%
9	4	< 0.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66468	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	33232	50.0%
.	16617	25.0%
2	16615	25.0%
9	4	< 0.1%

danger
Categorical

CONSTANT
HIGH CORRELATION
MISSING
REJECTED

Distinct	1
Distinct (%)	4.5%
Missing	16595
Missing (%)	99.9%
Memory size	649.7 KiB

1.0	22

Length

Max length	3
Median length	3
Mean length	3
Min length	3

Characters and Unicode

Total characters	66
Distinct characters	3
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1.0
2nd row	1.0
3rd row	1.0
4th row	1.0
5th row	1.0

Value	Count	Frequency (%)
1.0	22	0.1%
(Missing)	16595	99.9%

Histogram of lengths of the category

Value	Count	Frequency (%)
1.0	22	100.0%

Most occurring characters

Value	Count	Frequency (%)
1	22	33.3%
.	22	33.3%
0	22	33.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	44	66.7%
Other Punctuation	22	33.3%

Most frequent character per category

Value	Count	Frequency (%)
1	22	50.0%
0	22	50.0%

Value	Count	Frequency (%)
.	22	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	66	100.0%

Most frequent character per script

Value	Count	Frequency (%)
1	22	33.3%
.	22	33.3%
0	22	33.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66	100.0%

Most frequent character per block

Value	Count	Frequency (%)
1	22	33.3%
.	22	33.3%
0	22	33.3%

gruz
Real number (ℝ_≥0)

Distinct	89
Distinct (%)	0.5%
Missing	130
Missing (%)	0.8%
Infinite	0
Infinite (%)	0.0%

Mean	305350.7256
Minimum	11005
Maximum	999993
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	11005
5-th percentile	236038
Q1	236038
median	321029
Q3	321067
95-th percentile	421161
Maximum	999993
Range	988988
Interquartile range (IQR)	85029

Descriptive statistics

Standard deviation	94031.56141
Coefficient of variation (CV)	0.307946088
Kurtosis	8.736833778
Mean	305350.7256
Median Absolute Deviation (MAD)	84991
Skewness	2.508222769
Sum	5034317413
Variance	8841934541
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
236038	6169	37.1%
321067	3683	22.2%
321029	2585	15.6%
321052	1136	6.8%
693087	487	2.9%
421034	417	2.5%
321048	404	2.4%
232153	270	1.6%
421161	209	1.3%
421087	192	1.2%
Other values (79)	935	5.6%
(Missing)	130	0.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
11005	8	< 0.1%
81135	1	< 0.1%
81145	1	< 0.1%
81188	2	< 0.1%
91118	7	< 0.1%
92040	2	< 0.1%
92055	1	< 0.1%
93039	34	0.2%
93043	19	0.1%
123041	2	< 0.1%

Value	Count	Frequency (%)
999993	5	< 0.1%
921062	1	< 0.1%
693227	87	0.5%
693176	1	< 0.1%
693161	3	< 0.1%
693087	487	2.9%
691005	1	< 0.1%
682237	4	< 0.1%
634089	1	< 0.1%
542239	4	< 0.1%

loaded
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

operation_car
Categorical

CONSTANT
HIGH CORRELATION
REJECTED

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	990.0 KiB

28.0	16617

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	66468
Distinct characters	4
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	28.0
2nd row	28.0
3rd row	28.0
4th row	28.0
5th row	28.0

Value	Count	Frequency (%)
28.0	16617	100.0%

Histogram of lengths of the category

Value	Count	Frequency (%)
28.0	16617	100.0%

Most occurring characters

Value	Count	Frequency (%)
2	16617	25.0%
8	16617	25.0%
.	16617	25.0%
0	16617	25.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	49851	75.0%
Other Punctuation	16617	25.0%

Most frequent character per category

Value	Count	Frequency (%)
2	16617	33.3%
8	16617	33.3%
0	16617	33.3%

Value	Count	Frequency (%)
.	16617	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	66468	100.0%

Most frequent character per script

Value	Count	Frequency (%)
2	16617	25.0%
8	16617	25.0%
.	16617	25.0%
0	16617	25.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	66468	100.0%

Most frequent character per block

Value	Count	Frequency (%)
2	16617	25.0%
8	16617	25.0%
.	16617	25.0%
0	16617	25.0%

operation_date
Categorical

HIGH CARDINALITY

Distinct	2162
Distinct (%)	13.0%
Missing	0
Missing (%)	0.0%
Memory size	1.2 MiB

2020-07-17 05:50:00	123
2020-07-20 07:15:00	89
2020-07-20 04:00:00	85
2020-07-17 07:00:00	78
2020-07-14 10:00:00	77
Other values (2157)	16165

Length

Max length	19
Median length	19
Mean length	19
Min length	19

Characters and Unicode

Total characters	315723
Distinct characters	13
Distinct categories	4 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	1113 ?
Unique (%)	6.7%

Sample

1st row	2020-07-16 00:10:00
2nd row	2020-07-15 20:00:00
3rd row	2020-07-16 11:00:00
4th row	2020-07-15 20:00:00
5th row	2020-07-15 20:00:00

Value	Count	Frequency (%)
2020-07-17 05:50:00	123	0.7%
2020-07-20 07:15:00	89	0.5%
2020-07-20 04:00:00	85	0.5%
2020-07-17 07:00:00	78	0.5%
2020-07-14 10:00:00	77	0.5%
2020-07-22 02:50:00	74	0.4%
2020-07-29 07:00:00	66	0.4%
2020-07-15 20:00:00	66	0.4%
2020-07-19 08:55:00	64	0.4%
2020-07-26 11:03:00	63	0.4%
Other values (2152)	15832	95.3%

Histogram of lengths of the category

Value	Count	Frequency (%)
2020-07-20	1218	3.7%
2020-07-17	1160	3.5%
2020-07-28	1145	3.4%
2020-07-23	1132	3.4%
2020-07-22	1127	3.4%
2020-07-27	1097	3.3%
2020-07-29	1063	3.2%
2020-07-14	1054	3.2%
2020-07-18	984	3.0%
2020-07-16	983	3.0%
Other values (913)	22271	67.0%

Most occurring characters

Value	Count	Frequency (%)
0	107815	34.1%
2	49895	15.8%
-	33234	10.5%
:	33234	10.5%
7	21068	6.7%
1	20078	6.4%
	16617	5.3%
5	8567	2.7%
3	7267	2.3%
4	5483	1.7%
Other values (3)	12465	3.9%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	232638	73.7%
Dash Punctuation	33234	10.5%
Other Punctuation	33234	10.5%
Space Separator	16617	5.3%

Most frequent character per category

Value	Count	Frequency (%)
0	107815	46.3%
2	49895	21.4%
7	21068	9.1%
1	20078	8.6%
5	8567	3.7%
3	7267	3.1%
4	5483	2.4%
8	4828	2.1%
9	3992	1.7%
6	3645	1.6%

Value	Count	Frequency (%)
-	33234	100.0%

Value	Count	Frequency (%)
	16617	100.0%

Value	Count	Frequency (%)
:	33234	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	315723	100.0%

Most frequent character per script

Value	Count	Frequency (%)
0	107815	34.1%
2	49895	15.8%
-	33234	10.5%
:	33234	10.5%
7	21068	6.7%
1	20078	6.4%
	16617	5.3%
5	8567	2.7%
3	7267	2.3%
4	5483	1.7%
Other values (3)	12465	3.9%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	315723	100.0%

Most frequent character per block

Value	Count	Frequency (%)
0	107815	34.1%
2	49895	15.8%
-	33234	10.5%
:	33234	10.5%
7	21068	6.7%
1	20078	6.4%
	16617	5.3%
5	8567	2.7%
3	7267	2.3%
4	5483	1.7%
Other values (3)	12465	3.9%

operation_st_esr
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	345
Distinct (%)	2.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	911542.8644
Minimum	830003
Maximum	998100
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	830003
5-th percentile	841402
Q1	871501
median	915502
Q3	950807
95-th percentile	972806
Maximum	998100
Range	168097
Interquartile range (IQR)	79306

Descriptive statistics

Standard deviation	44676.22042
Coefficient of variation (CV)	0.04901165065
Kurtosis	-1.121618052
Mean	911542.8644
Median Absolute Deviation (MAD)	35706
Skewness	-0.1458225955
Sum	1.514710778 × 10¹⁰
Variance	1995964671
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
841402	721	4.3%
863007	664	4.0%
893708	497	3.0%
912805	374	2.3%
963506	326	2.0%
841604	310	1.9%
953203	306	1.8%
972806	297	1.8%
949104	295	1.8%
911709	281	1.7%
Other values (335)	12546	75.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
830003	9	0.1%
830200	154	0.9%
830709	9	0.1%
831203	1	< 0.1%
831504	1	< 0.1%
831608	2	< 0.1%
832206	13	0.1%
832309	1	< 0.1%
832600	5	< 0.1%
832704	2	< 0.1%

Value	Count	Frequency (%)
998100	7	< 0.1%
997502	14	0.1%
996302	6	< 0.1%
995808	18	0.1%
995507	3	< 0.1%
994701	4	< 0.1%
994400	7	< 0.1%
993304	148	0.9%
992405	12	0.1%
992000	16	0.1%

operation_st_id
Real number (ℝ_≥0)

Distinct	345
Distinct (%)	2.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2000532890
Minimum	2000035110
Maximum	2002023867
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	2000035110
5-th percentile	2000035642
Q1	2000036422
median	2000038088
Q3	2001930550
95-th percentile	2001933494
Maximum	2002023867
Range	1988757
Interquartile range (IQR)	1894128

Descriptive statistics

Standard deviation	833013.5554
Coefficient of variation (CV)	0.0004163958312
Kurtosis	-0.8208829307
Mean	2000532890
Median Absolute Deviation (MAD)	1716
Skewness	1.085805461
Sum	3.324285503 × 10¹³
Variance	6.939115835 × 10¹¹
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2001930642	721	4.3%
2001933494	664	4.0%
2000036018	497	3.0%
2000036350	374	2.3%
2000038468	326	2.0%
2001930646	310	1.9%
2000038222	306	1.8%
2000038722	297	1.8%
2000037980	295	1.8%
2000036344	281	1.7%
Other values (335)	12546	75.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2000035110	4	< 0.1%
2000035130	4	< 0.1%
2000035162	222	1.3%
2000035182	67	0.4%
2000035212	6	< 0.1%
2000035224	26	0.2%
2000035232	2	< 0.1%
2000035252	1	< 0.1%
2000035344	2	< 0.1%
2000035438	10	0.1%

Value	Count	Frequency (%)
2002023867	56	0.3%
2001933536	60	0.4%
2001933522	56	0.3%
2001933518	70	0.4%
2001933514	6	< 0.1%
2001933508	2	< 0.1%
2001933504	138	0.8%
2001933500	74	0.4%
2001933498	3	< 0.1%
2001933494	664	4.0%

operation_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

receiver
Real number (ℝ_≥0)

Distinct	169
Distinct (%)	1.0%
Missing	127
Missing (%)	0.8%
Infinite	0
Infinite (%)	0.0%

Mean	17705648.07
Minimum	0
Maximum	99849255
Zeros	63
Zeros (%)	0.4%
Memory size	129.9 KiB

Quantile statistics

Minimum	0
5-th percentile	83262
Q1	1099058
median	4733952
Q3	14999355
95-th percentile	68594560
Maximum	99849255
Range	99849255
Interquartile range (IQR)	13900297

Descriptive statistics

Standard deviation	24110999.01
Coefficient of variation (CV)	1.361768793
Kurtosis	1.238463128
Mean	17705648.07
Median Absolute Deviation (MAD)	4650690
Skewness	1.579045294
Sum	2.919661367 × 10¹¹
Variance	5.813402731 × 10¹⁴
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14999355	3818	23.0%
83262	1184	7.1%
1098923	1101	6.6%
4733952	801	4.8%
1099182	752	4.5%
67918167	650	3.9%
68594560	615	3.7%
1099058	538	3.2%
1099064	513	3.1%
1098969	440	2.6%
Other values (159)	6078	36.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	63	0.4%
83262	1184	7.1%
186424	2	< 0.1%
186476	1	< 0.1%
282398	2	< 0.1%
1058964	33	0.2%
1059082	3	< 0.1%
1089278	13	0.1%
1089290	1	< 0.1%
1089396	20	0.1%

Value	Count	Frequency (%)
99849255	4	< 0.1%
98098048	1	< 0.1%
97773571	1	< 0.1%
96239734	1	< 0.1%
93775225	1	< 0.1%
93773539	1	< 0.1%
92191551	2	< 0.1%
90378185	281	1.7%
88494276	1	< 0.1%
87045988	107	0.6%

rodvag
Real number (ℝ_≥0)

Distinct	10
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	64.44803514
Minimum	20
Maximum	99
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	20
5-th percentile	40
Q1	40
median	40
Q3	90
95-th percentile	90
Maximum	99
Range	79
Interquartile range (IQR)	50

Descriptive statistics

Standard deviation	25.19690318
Coefficient of variation (CV)	0.390964645
Kurtosis	-1.940986595
Mean	64.44803514
Median Absolute Deviation (MAD)	20
Skewness	0.003313810892
Sum	1070933
Variance	634.8839298
Monotocity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
40	8152	49.1%
90	8120	48.9%
20	181	1.1%
60	144	0.9%
95	11	0.1%
70	4	< 0.1%
93	2	< 0.1%
87	1	< 0.1%
96	1	< 0.1%
99	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
20	181	1.1%
40	8152	49.1%
60	144	0.9%
70	4	< 0.1%
87	1	< 0.1%
90	8120	48.9%
93	2	< 0.1%
95	11	0.1%
96	1	< 0.1%
99	1	< 0.1%

Value	Count	Frequency (%)
99	1	< 0.1%
96	1	< 0.1%
95	11	0.1%
93	2	< 0.1%
90	8120	48.9%
87	1	< 0.1%
70	4	< 0.1%
60	144	0.9%
40	8152	49.1%
20	181	1.1%

rod_train
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

sender
Real number (ℝ_≥0)

Distinct	168
Distinct (%)	1.0%
Missing	127
Missing (%)	0.8%
Infinite	0
Infinite (%)	0.0%

Mean	18281683.68
Minimum	0
Maximum	99849255
Zeros	75
Zeros (%)	0.5%
Memory size	129.9 KiB

Quantile statistics

Minimum	0
5-th percentile	83262
Q1	1098969
median	4733952
Q3	21871408
95-th percentile	68594560
Maximum	99849255
Range	99849255
Interquartile range (IQR)	20772439

Descriptive statistics

Standard deviation	23990613.33
Coefficient of variation (CV)	1.312275923
Kurtosis	0.7616405423
Mean	18281683.68
Median Absolute Deviation (MAD)	4650690
Skewness	1.4417245
Sum	3.014649639 × 10¹¹
Variance	5.755495277 × 10¹⁴
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14999355	3523	21.2%
83262	1107	6.7%
1098923	823	5.0%
1098969	716	4.3%
1099182	682	4.1%
67918167	663	4.0%
68594560	632	3.8%
21871408	551	3.3%
4733952	522	3.1%
49721291	521	3.1%
Other values (158)	6750	40.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75	0.5%
83262	1107	6.7%
186424	7	< 0.1%
1055693	10	0.1%
1058964	10	0.1%
1059018	5	< 0.1%
1059082	170	1.0%
1068610	2	< 0.1%
1080509	1	< 0.1%
1086742	1	< 0.1%

Value	Count	Frequency (%)
99849255	1	< 0.1%
99339028	1	< 0.1%
96239734	6	< 0.1%
93700380	1	< 0.1%
90378185	194	1.2%
90350471	1	< 0.1%
87326173	2	< 0.1%
87045988	86	0.5%
84939521	11	0.1%
84480471	3	< 0.1%

ssp_station_esr
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

ssp_station_id
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

tare_weight
Real number (ℝ_≥0)

Distinct	133
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	239.3455497
Minimum	184
Maximum	890
Zeros	0
Zeros (%)	0.0%
Memory size	129.9 KiB

Quantile statistics

Minimum	184
5-th percentile	184
Q1	205
median	223
Q3	237
95-th percentile	510
Maximum	890
Range	706
Interquartile range (IQR)	32

Descriptive statistics

Standard deviation	83.95213728
Coefficient of variation (CV)	0.350757043
Kurtosis	8.520366671
Mean	239.3455497
Median Absolute Deviation (MAD)	14
Skewness	2.98427585
Sum	3977205
Variance	7047.961354
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
184	3983	24.0%
210	1810	10.9%
232	1387	8.3%
237	1325	8.0%
230	1131	6.8%
240	842	5.1%
209	739	4.4%
225	558	3.4%
222	393	2.4%
212	358	2.2%
Other values (123)	4091	24.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
184	3983	24.0%
192	1	< 0.1%
195	1	< 0.1%
198	47	0.3%
203	47	0.3%
204	26	0.2%
205	150	0.9%
207	27	0.2%
208	4	< 0.1%
209	739	4.4%

Value	Count	Frequency (%)
890	1	< 0.1%
690	44	0.3%
663	4	< 0.1%
639	2	< 0.1%
625	28	0.2%
620	12	0.1%
610	1	< 0.1%
580	1	< 0.1%
570	20	0.1%
550	59	0.4%

weight_brutto
Unsupported

MISSING
REJECTED
UNSUPPORTED

Missing	16617
Missing (%)	100.0%
Memory size	129.9 KiB

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	df_index	index_train	length	car_number	destination_esr	adm	danger	gruz	loaded	operation_car	operation_date	operation_st_esr	operation_st_id	operation_train	receiver	rodvag	rod_train	sender	ssp_station_esr	ssp_station_id	tare_weight	weight_brutto
0	11780	NaN	1.41	94541943	940105.0	20.0	NaN	693087.0	NaN	28.0	2020-07-16 00:10:00	940105.0	2.000038e+09	NaN	20407488.0	96.0	NaN	20407488.0	NaN	NaN	240.0	NaN
1	18850	NaN	1.06	94976461	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	198.0	NaN
2	18854	NaN	1.06	94976131	853503.0	20.0	NaN	321067.0	NaN	28.0	2020-07-16 11:00:00	853503.0	2.001931e+09	NaN	49721291.0	90.0	NaN	83262.0	NaN	NaN	198.0	NaN
3	18855	NaN	1.06	94975745	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	204.0	NaN
4	18866	NaN	1.06	94978376	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	198.0	NaN
5	18868	NaN	1.06	94977535	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	204.0	NaN
6	18883	NaN	1.06	94973989	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	198.0	NaN
7	18887	NaN	1.06	94973625	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	204.0	NaN
8	18891	NaN	1.06	94972650	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	90.0	NaN	1098923.0	NaN	NaN	198.0	NaN
9	18899	NaN	1.06	94975505	861209.0	20.0	NaN	321067.0	NaN	28.0	2020-07-15 19:50:00	861209.0	2.001931e+09	NaN	49721291.0	90.0	NaN	49721291.0	NaN	NaN	198.0	NaN

Last rows

	df_index	index_train	length	car_number	destination_esr	adm	danger	gruz	loaded	operation_car	operation_date	operation_st_esr	operation_st_id	operation_train	receiver	rodvag	rod_train	sender	ssp_station_esr	ssp_station_id	tare_weight	weight_brutto
16607	4071058	NaN	1.06	42482679	918407.0	20.0	NaN	321067.0	NaN	28.0	2020-07-16 00:00:00	918407.0	2.000036e+09	NaN	14999355.0	40.0	NaN	14999355.0	NaN	NaN	210.0	NaN
16608	4071308	NaN	1.06	43137660	930305.0	20.0	NaN	254159.0	NaN	28.0	2020-07-16 10:53:00	930305.0	2.000037e+09	NaN	87045988.0	40.0	NaN	87045988.0	NaN	NaN	220.0	NaN
16609	4071328	NaN	1.06	43041771	871200.0	20.0	NaN	321067.0	NaN	28.0	2020-07-15 20:18:00	871200.0	2.001934e+09	NaN	4733892.0	40.0	NaN	1098923.0	NaN	NaN	210.0	NaN
16610	4071363	NaN	1.06	43025733	862803.0	20.0	NaN	321029.0	NaN	28.0	2020-07-15 20:00:00	862803.0	2.001931e+09	NaN	1098923.0	40.0	NaN	1098923.0	NaN	NaN	210.0	NaN
16611	4071479	NaN	1.06	42716340	971201.0	20.0	NaN	351043.0	NaN	28.0	2020-07-16 06:21:00	971201.0	2.000039e+09	NaN	14999355.0	40.0	NaN	14999355.0	NaN	NaN	209.0	NaN
16612	4071545	NaN	1.06	43568575	841402.0	20.0	NaN	321067.0	NaN	28.0	2020-07-16 05:34:00	841402.0	2.001931e+09	NaN	83262.0	40.0	NaN	83262.0	NaN	NaN	209.0	NaN
16613	4071554	NaN	1.06	43578178	930305.0	20.0	NaN	414168.0	NaN	28.0	2020-07-16 11:21:00	930305.0	2.000037e+09	NaN	87045988.0	40.0	NaN	87045988.0	NaN	NaN	221.0	NaN
16614	4144452	NaN	1.00	61716221	851809.0	20.0	NaN	232431.0	NaN	28.0	2020-07-16 09:20:00	851809.0	2.001931e+09	NaN	46620009.0	60.0	NaN	57897062.0	NaN	NaN	240.0	NaN
16615	4159387	NaN	1.00	60138401	840005.0	20.0	NaN	232431.0	NaN	28.0	2020-07-16 14:44:00	840005.0	2.001931e+09	NaN	0.0	60.0	NaN	0.0	NaN	NaN	240.0	NaN
16616	4175448	NaN	1.00	63856223	840005.0	20.0	NaN	91118.0	NaN	28.0	2020-07-16 13:25:00	840005.0	2.001931e+09	NaN	0.0	60.0	NaN	0.0	NaN	NaN	243.0	NaN

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Most occurring characters

Most occurring categories

Most frequent character per category

Most occurring scripts

Most frequent character per script

Most occurring blocks

Most frequent character per block

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows